Sensory Attention : Computational Sensor Paradigm for Low – Latency Adaptive Vision

نویسندگان

  • Takeo Kanade
  • Robert T. Collins
  • Alan J. Lipton
  • Larry Davis
  • Rama Chellappa
  • Shmuel Peleg
  • Amnon Shashua
  • Daphna Weinshall
  • Michael Werman
  • Zoran Duric
  • Ehud Rivlin
چکیده

1 The need for robust self–contained and low-latency vision systems is growing: high speed visual servo-ing and vision–based human computer interface. Conventional vision systems can hardly meet this need because 1) the latency is incurred in a data transfer and computational bottlenecks, and 2) there is no top–down feedback to adapt sensor performance for improved robustness. In this paper we present a tracking computational sensor — a VLSI implementation of a sensory attention. The tracking sensor focuses attention on a salient feature in its receptive field and maintains this attention in the world coordinates. Using both low –latency massive parallel processing and top–down sensory adaptation, the sensor reliably tracks features of interest while it suppresses other irrelevant features that may interfere with the task at hand.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Computational Sensors for Global Operations in Vision

The performance of existing machine vision systems still significantly lags that of a biological vision. The two most critical features presently missing from the machine vision are low latency processing and toppdow1z sensory aduptation. This thesis proposes to overcome these two deficiencies by implementing global operations in computational sensors. Computational se.nsors incorporate computa...

متن کامل

Integrated Vision and Sensing for Human Sensory Augmentation

The Carnegie Mellon University MURI project sponsored by ONR performs multi-disciplinary research in integrating vision algorithms with sensing technology for low-power, low-latency, compact adaptive vision systems. These are crucial features necessary for augmenting the human sensory system and enabling sensory driven information delivery. The project spans four subareas ranging from low to hi...

متن کامل

A VLSI sorting image sensor: global massively parallel intensity-to-time processing for low-latency adaptive vision

This paper presents a new intensity–to–time processing paradigm suitable for VLSI computational sensor implementation of global operations over sensed images. Global image quantities usually describe images with fewer data. When computed at the point of sensing, global quantities result in a low– latency performance due to the reduced data transfer requirements between an image sensor and a pro...

متن کامل

A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors

The need for low-latency vision systems is growing: high speed visual servoing and vision–based human computer interface. In this paper we present a new intensity–to–time processing paradigm suitable for low–latency massively parallel global computation over fine–grained data such as images. As an example of a low–latency global computation, we have developed a VLSI sorting computational sensor...

متن کامل

Computational Sensor for Visual Tracking with Attention

This paper presents a VLSI embodiment of an optical tracking computational sensor which focuses attention on a salient target in its field of view. Using both low-latency massive parallel processing and top-down sensory adaptation, the sensor suppresses interference from features irrelevant for the task at hand, and tracks a target of interest at speeds of up to 7000 pixels/s. The sensor locks ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007